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Abstract 

We study a free energy computation procedure, introduced in [5] [8], wliicli relies on the long-time 
behavior of a nonlinear stochastic differential equation. This nonlinearity comes from a conditional 
expectation computed with respect to one coordinate of the solution. The long-time convergence 
of the solutions to this equation has been proved in [TT], under some existence and regularity 
assumptions. 

In this paper, we prove existence and uniqueness under suitable conditions for the nonlinear 
equation, and we study a particle approximation technique based on a Nadaraya- Watson estimator 
of the conditional expectation. The particle system converges to the solution of the nonlinear 
equation if the number of particles goes to infinity and then the kernel used in the Nadaraya- Watson 
approximation tends to a Dirac mass. 

We derive a rate for this convergence, and illustrate it by numerical examples on a toy model. 
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Introduction 



Free energy computations are an important problem in the field of molecular simulation (see [1]). 
The difficulty of those computations lies in the fact that most dynamics in molecular simulations are 
highly metastable: many free energy barriers prevent a good sampling. We study here the adaptive 
biasing force (ABF) method, which was introduced in [5] |H] to get rid of those metastabilities. 

The typical problems one can think about are the study of a structural angle in the conformation 
of a protein, or the measure of the evolution of a chemical reaction. Mathematically, each configu- 
ration of the system is modelized by an element of a high-dimensional state space D, typically an 
open subset of R**, which is endowed with a probability measure, called the canonical measure. This 
measure is given by (J^ e~^^'^'da:)~^e~''^'^'da:, where V denotes the potential energy undergone 
by the physical system, and /3 is proportional to the inverse of the temperature of the system. 

For some x in the state space, one is interested in a particular quantity, denoted by £,{x), ^ being 
assumed to be a smooth function from D to the one-dimensional torus T. The quantity ^(x) has 
to be understood as a coarse-grained information on the system, which is the relevant information 
for the practitioner. In the examples above, ^{x) would be a structural angle in a protein with 
conformation x, or a number measuring the evolution of a chemical system in state x. 
We call free energy the effective energy associated to the quantity ^(x), that is, the function A{z) 
such that e~^^'^^^Az is the image measure of the canonical measure by the function 5. Our objective 
is to compute numerically the function A. When D = R'', a naive method to do so is to simulate, 
for a given random variable Xo and an independent R''— valued Brownian motion W, the process 
defined by the (overdamped) Langevin dynamics 

AXt = -~VV{Xt)At + \/2/3-idm, (0.1) 

which, under some regularity assumptions on the potential, is ergodic and admits the canonical 
measure as unique invariant measure. This approach appears to be untractable in practice, since 
the convergence to equilibrium is very slow, due to multiple metastabilities appearing in most 
problems: typically, a molecule moves microscopically within times of order 10~^^ seconds, while 
the typical time scale of the macroscopic moves is of order 10~^ seconds. 

The idea of the ABF method is to prevent the process Xt from staying in metastable states by 
introducing a biasing force which repel Xt from the states where it stayed for too long a time. To 
do this, we use the following representation of A, that can be deduced from the co-area formula 
(see [n]): 

A'(^) =E[F(X)|e(X) = (0.2) 

where X is a random variable distributed according to the canonical measure, and F is the function 
defined by 

The function A' is called the mean force. Actually, (|0.2p also holds when X is distributed according 
to the measure ^ 

(/ e"''*^*'''^'^°**''"dx^ ^-P(y(.^)+wo^{x))^^^ 

which is the canonical measure associated with the biased potential V + W o ^ where W is any 
smooth function. 

Equation 1)0. 2[) leads us to consider the following dynamics, which should get rid of metastabilities 
for a well chosen ^ since it "fiattens" the energy landscape in the ^ direction (see [11] and Lemma [1.2 1 
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below for more precise statements): 



[A'.iz) ^E[F{X^mX^)^z]. ^ ' ' 

The second equality in (|0.4p shows that if Xt is distributed according to the canonical measure 
associated with the potential V — A o ^, then the biasing force A't is actually the derivative A' of 
the free energy, and the first equation in (|0.4p consists in a Langevin dynamics associated to the 
potential V — A o ^. Consequently, the dynamics (|0.4|l admits a stationary point: A't = A' and 
Law(Xt) = (/j,e-^+^°«da;)-ie-^+'*°«da;. 

If we actually have convergence to this stationary state, we have a method, that should be 
efficient (i.e. that should not see the metastabilities) , to sample the canonical measure up to a 
known perturbation e^°^. This algorithm has thus two applications: it allows the computation of 
the free energy A, and it can be used as an adaptative importance sampling method for the canonical 
measure. 

The long time behavior of Equation (|0.4p has been studied in [IT], where it has been proven 
that for a sufficiently regular solution, one has, in some sense, an exponential convergence to the 
stationary state, with a rate that is better (for a well chosen ^) than the rate of convergence to 
equilibrium for (|0.1|l . 

The practical difficulty in simulating (10. 4p is to compute the conditional expectation, which is 
a highly nonlinear term. Stochastic differential equations involving conditional expectations have 
already been studied, in a case where the conditional expectation is computed with respect to 
a random initial condition (see [161 118) ) or where the variable whose conditional expectation is 
computed is fixed (see [7]). Our situation is much more complex since both the conditioning and 
the conditioned variables change with time and are affected by the previous conditional expectations. 

The same difficulty arises in Lagrangian stochastic models which are commonly used in the 
simulation of turbulent flows (see [^). The main difference between the system studied in [2] 
and (|0.4p is that the authors considers a Langevin dynamics with noise only on the velocity. The lack 
of ellipticity then leads to additional difficulties. In our setting we are able to derive a quantitative 
error estimate for the particle discretization while this seems more difficult for Langevin dynamics. 

In this paper, we prove that existence and uniqueness hold for Equation (|0.4p under suitable 
conditions, and we study an approximation of Xt by an interacting particle system (see Theorems 1 1.3 1 
and 1 1.41 below). 

The paper is organized as follows. In Section [T] we state our main results. 

Section [2] is devoted to some uniqueness and regularity results. More precisely, we prove that 
the time marginals of a solution to Equation (|0.4|l satisfy some partial differential equation. Then, 
under an integrability condition on the initial condition, we prove uniqueness for the solutions to 
this equation, so that the nonlinear term in (|U.4|I is reduced to a bounded drift coefficient. We thus 
prove pathwise uniqueness and uniqueness in distribution for the solutions of (|0.4|l . 

Section [3] is devoted to existence results. More precisely, we introduce a regularization of the 
dynamics (|0.4p involving two parameters a and e, which is another nonlinear stochastic differential 
equation whose nonlinearity is less singular. We prove that strong existence, pathwise uniqueness 
and uniqueness in distribution hold for this equation and then we show that the solutions to this 
stochastic differential equation converge to some process which satisfies (|0.4p in the limit (a, e) — > 
(0,0), yielding strong existence. We also prove that this convergence holds with rate 0{a + ^/e)- 

In Section [4] we introduce an interacting particle system to approximate the regularized dynam- 
ics, and we prove a propagation-of-chaos result for this particle system. We also derive a rate of 
convergence for this propagation of chaos. 

In Section O we illustrate the efficiency of the particle approximation of the ABF method and 
the rate of those convergences with some numerical examples in small dimension. 
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Notation 

We denote by T = R/Z the one dimensional torus, and for a; e R, we denote by {x} € T its 
projection on T. In the following, wc will work in two different domains V: T x R'^~^ or T"^. The 
case V = T X W^~-^ will be called the non compact case, and the case 2? = T"* will be called the 
compact case. For x £ R'^, depending on the case considered, we will also denote by {a;} the element 
of T X R'*-i (resp. T"*) defined by {a;} = ({a;^}, a;^ . . . , a;'') (resp. {a;} = ({a;^}, . . . , {a;''})). 

In the following, we will call "function defined on T" (resp. on T x R'*"'^, resp. on T*^), a 
Z— periodical (resp. Z— periodical in the first coordinate, resp. Z'^-pcriodical) function defined on R 
(resp on R"*). Integrals on T, T x R'*"^ or T'' mean integrals on [0, 1), [0, 1) x R'*"^ or [0, 1)'*. 

We denote by L^(T'^) the space of functions on T'* whose square is integrable on T*^, and by 
IHI^(T'*) the space of functions in L^(T'*) whose weak gradient is square integrable on T**. We use 
similar notations on T x R'*"^ and T. 

For two functions / and g defined on T x R''"^ or T**, we denote f*g the convolution with respect 
to the first coordinate, that is, 

f*g{x)= / /(a;^ - j/\a;^ •■■'*)g(j/\a;^- ■■'^)dj/\ 
Jt 

If / is defined on T, we also use the notation f * g to denote 

f*g{x)= / f{x^ - y^)g{y^,x'^ -'')dy^. 
Jt 

When / and g are defined on D = T x R'*~^ or T**, the convolution in all the coordinates is denoted 

J. f \ I rr i 1 2...d 2...d\ I 1 2...d\j Ij 2...d 

f*9{x)^ f(x -y ,x -y )g(y ,y )dy dy 

J-D 

In the following, we call "probability measure on T" (resp. on T x R''"'^, T'') a nonnegative 
Z-periodical (resp. Z-periodical with respect to the first coordinate, Z'*-periodical) measure n such 
that ^i([0, 1)) = 1 (resp ^t([0, 1) x W^-^) = 1, ^([0, l)"*) = 1). 

When {X} is a random variable taking values in T (resp. in T x R*^"^, T'*), we call "distribution 
of {Xy or "law of {X}" the probability measure on T (resp. on T x R'^-^, T'') such that 

= j f{xMdx). 

For a given probability measure p on T x R'*"^ (resp. a probability density u) and a given 
bounded function g, we denote jjb^ (resp. {x^)dx^) the marginal on T of the measure g.ix (resp. 
g(x)M(a;)da;). Namely: 

t,%A) = f gdii 

and 

g/ 1\ / /I 2...d\ I 1 2...(iij 2...d 

u (x ) = I gyx ,x )u(x ,x )dx 

jRd-l 

In particular, fi^ is the first coordinate marginal of fi. When we do not specify the measure in an 
integral, it is the Lebesgue measure. 
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We will need the weighted spaces 
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for 1 < p < oo, and 



I \iTxIR''-l / 



with = (1 + 



for some A > (d — l)/2. Notice that w does not depend on the first 



coordinate , and that there is a positive constant K such that 

d 

G T X R'*'\ lVu>(x)| < 2A(i + ^ |a;*l < Kw{x). (0.5) 

i=2 

We will use several times the following statement: 
Lemma 0.1. For a bounded function g, and u G L^(w) one has, for some constant K, 

I|w®IIl2(T) < -f^ll5llL==(TxEd-l)ll"llL2(„)- 

If moreover, g has hounded derivatives and u G IHI"'^(to), then 

\\u^\\m^(J) < -ft''llffllwl.°^(TxK<i-l)ll'"llHl{«;)- 

The same inequalities hold with the non weighted norms m the right-hand side, for u respectively in 
1?{T'^) and¥}{Y). 

Proof. Recall that we assumed A > so that ^ is integrable on : J^^ :^da; < oo. Consequently, 
we have the estimation 



-1 



gu 



< 



IIl°°(txM''-1) 

l|2 



< -^ll5llLoo(Txld-l)lhllL2(™)- 



1 

d-1 W 



The proof is similar in the space M^{w). □ 
In the following, K will denote some positive constant, whose value can change from line to line. 



1 Assumptions and statement of the main results 

In this paper, we consider a particular case of Equation (|0.4p to simplify the argumentation: we 
assume /3 — 1 (this can be realized by a change of variable), V — T x R''"^ or I? = T"*. We consider as 
reaction coordinate the first coordinate function ^ : 2? — > R defined by ^(a;) — ^{x^ ,x^, . . . , x'^) — x^ . 
This should not change the theoretical results, but will simplify the proofs. The definition (|0.3p of 
F is then reduced to 

F = diV, 

where V is defined on T'' or T x R'*"^ 
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The two settings D = T"* and T> = T x R"^"^ will be respectively called the compact and the 
non-compact case. Our results hold in both settings, and the proofs are mostly identical, with some 
slight additional difficulties in the non compact case. Thus, in those situations, we only give the 
proofs in the non-compact case. 

With those assumptions, Equation (|0.4p rewrites 

dXt = {~ VV{Xt) + E [diV{Xt)\{Xl}] ei)dt + V2dWt, (1.1) 

ei denoting the first vector in the canonical basis of R'*. We will call solution to Equation (|l.ip a 
process {Xt} where Xt satisfies (|l.ip . The initial condition of p.ip is a random variable denoted Xq, 
and is supposed to be independent of the Brownian motion W . We denote by Po the law of {Xo}, 
which is a probability measure on D. 

To ensure the integrability of diV{Xt), we make the following assumption : 

Assumption i. V is a twice continuously differentiable function, which has bounded first and second 
order partial derivatives. 

Notice that Assumption |T] yields boundedness of the drift coefficient in (jl.ip . In the compact 
case, assumption |T] is satisfied as soon as is a twice differentiable function. 

We have to make some assumptions on the initial condition Xo- What is needed to prove our 
results will depend on whether we consider the compact or the non compact case. In the compact 
case, we consider the following assumption: 

Assumption ii. The probability measure Pq has a density po lying in L^(T'*) and whose first 
coordinate marginal Pq is bounded from below by a positive constant. (Notice that p}, is a probability 
density onT.) 

In the non compact case, we will need a stronger assumption: we have to control the decay of 
the initial condition at infinity, so we work in the weighted space L2(w). We wiU use, in addition to 
Assumption [uj the following one: 

Assumption iii. The density po of Po lies in both (w) and (w) . 

Notice that Assumptions [m] implies that {Xo} has finite moments of order less than 2A, and that 
Assumption|T]then yields a control on the corresponding moments of any solution to (|l.ip . uniformly 
in t e R : 

Lemma 1.1. Under Assumvtions Rl and [ml on any bounded time interval [0,r], the moments of 
order less than 2A of any solution X of (II. ip are bounded: 

sup E[|Xtl^^] < oo. 

0<t<T 

Proof. This comes from the boundedness of the drift coeficient bs{x) = —'W{x) + 'K[diV{X)\X^ = 
x^], which holds in regard of Assumption [11 Indeed, we have E[|Xt|^^] — E[|Xo + bs{Xs)ds + 
V2Wt\^^] < K {E[\Xo\'^^] + + t^), which is bounded on [0, T]. □ 

According to the following fundamental lemma, the solution to (|l.ip is going to sample efficiently 
the coordinate reaction state space T. 

Lemma 1.2. Denote by Pt the law of {Xt}, where Xt is a solution to Equation (|l.ip . Then, Pt 
has a density pi, such that p^ satisfies the heat equation on T with initial condition pq. Thus, p^ is 
uniquely defined on T x [0, oo), and smooth on T x (0, oo). 

Proof of Lemma \l.S\ Let / be a smooth function on T. One has, by Ito's formula 

ftE [fix])] = -E [f'{X])d,V{Xt)\ +E [/'(X,^)E [d,V{Xt)\{X]}]] +E [/"(X,^)] . 
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But, / being a function on T, f'{Xl) only depends on {X}}, so that the two first terms in the right 
hand side cancel. Then, it holds 

ftE [fix])] = E [fiXl)] , 

which is exactly the heat equation in the weak sense for t t-^ pj, pj being the distribution of {X]}. 
For uniqueness and regularity of this solution, see 6, Chapter XIV]. □ 

Lemma [1 . 2 1 allows us to rewrite equation (jLlf) using the distribution of {X]}. Indeed, since 
has a density, the measure given for A C [0,1) by Pf^^ (A) — E [diV{Xt)lA{{X}})] also has a 
density pf^^. We can thus write 




diV 



^ViXt) + "^i^g^' eij dt + V2dWt, 
distribution of {Xt}. 



(1.2) 



Moreover, under Assumption[u]the density pj satisfies < infxPo ^ ph uniformly in time, thanks to 
the maximum principle. This assumption will consequently prevent the denominator in the second 
term of (|1.2[1 from vanishing. 

In view of Equation 1)1. 2[) . a natural particle approximation of Xt is then obtained using the 
Nadaraya- Watson estimator of a conditional expectation (see [12]), given, for some parameter rj and 
for a positive integer A'^, by the system of A*' stochastic differential equations 

JVV I V7T/^V»7 ^ 1 '^m = l'fivi^t,'n,N ~ ^t,m,N)9lV{X^^^) \ /TTjTrrn , ^ ^ j.r 

d^t n,iv = -^ViKn.N) + „jv ' „^ 1 ' ^ 1 , ' — ^1 dt+V2dWt ,l<n<N 

(1.3) 

where (Wj") is a sequence of independent Brownian motions, and tpr) is a smooth approximation 
for the Dirac measure at the origin on T. For the initial condition, we work with the following 
assumption 

Assumption iv. The initial condition of Equation (|1.3p ts (Xq ^ ^)o<n<N ~ (Ao,n)o<n<jv, where 
iXo,n)neti 0, sequence of i.i.d random variables with density po, and independent of the Brownian 
motions {WP)t>o. 

We also need an assumption on the shape of iprj- The parameter rj — {a,e) will be chosen 
in (0, oo)^, and (/p^ will have the form 

(p,j{x) ^ a + tpe{x), (1.4) 

where tpe is a sequence of moUifiers on T as e — >■ 0. Namely, assuming e < 1/2, is a smooth 
non-negative Z-periodical function, such that t/je = on [—1/2, 1/2] \ [—£,£] and such that 



1/2 

i^e = 1. 

-1/2 



A simple way to construct such a sequence is to consider a smooth non-negative function -0 defined 
on R, with support in [—1,1] such that J^tp = 1, and then consider the Z-periodization tp^ of 
tpe = 7^(7) {"tpe is well defined for e < 1/2). This example makes the following assumption natural: 

Assumption v. The function V'e satisfies 

||^e||L°=(T) < Y' llV'ellL°°{T) < ^• 
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The reason for adding a positive constant a to the moUifier is to avoid singularities at the 
denominator in the right-hand side of p.3p . Notice that p.4|) yields strong existence and uniqueness 
for (|1.3|l . since the drift is globally Lipschitz continuous. 

We are going to prove the following two results: 

Theorem 1.3. [Existence and uniqueness of the solution] In both the compact and non compact 
cases, under Assumptions^ weak existence holds for Equation If P denotes the distribution 

of a solution, then for all s > the time marqinals Ps of P admits a density ps, such that for all 
0<t<T, 

p€L^{{t,T),L^{V))p\L^{{t,T),U\V)). (1.5) 

Moreover, under both Assumvtions\i\and\vi\ for the compact case, and under Assumvtions\il\vi\ and\iM 
for the non compact case, strong existence, pathwise uniqueness and uniqueness in distribution also 
hold, and one can take t = in (|1.5p . 

Theorem 1.4. [Particle approximation of the process Xt] In the compact case, under Assump- 
tions m [3 [13 and [u] or tn the non-compact case under the additional Assumption [ml define the 
processes Xt,n,N by (|1.3|l . Then, it holds that, for any positive T, and for a and e small enough. 



E„=l 



At 



L°°(T) 



N 



Theorem 11.31 is a consequence of Theorem 12.81 and Corollary 13.101 below, and Theorem 11.41 is a 
consequence of Theorems 13.111 and 14.11 below. 

The convergence rate in Theorem ll.4l is a pretty bad one, since for a given A'^ it explodes as e goes 
to 0. Consequently, the size e of the window has to be chosen carefully depending on the number 
N of particles. This is discussed more precisely in Section [S] 



2 Notion of solution, regularity and uniqueness results 

In this section we consider the Fokker-Planck equation associated to the nonlinear stochastic differ- 
ential equation (|l.ip and prove that uniqueness holds for weak solutions of this partial differential 
equation. From this uniqueness result, the study of Equation p.ip can be reduced to the study of 
a linear stochastic differential equation. We can thus prove uniqueness for Equation (|l.ip . 

Let us derive the Fokker-Planck equation associated to Equation (|l.ip . Let ?/) be a twice contin- 
uously differentiable function. Applying Ito's formula and taking the expectation, we obtain that 
the law Pt of a weak solution {Xt} to equation (jl.ip satisfies 

tIj(x)APt{x) ^ [ tP(x)APq{x)- [ [ VtP{x)-VV{x)dPt{x)dt-^ [ [ Ai[{x)dPt{x)dt 
JD Jo Jv Jo Jt> 

(2.1) 

T r /diV 



which is a weak formulation of the following partial differential equation 

dtPt = div (Pi + VPt) - di [Pt^^] ' (2-2) 

with initial condition Po . Using integration by parts, we introduce a stronger definition for solutions 
to l|2.2p which will allow us to prove existence and uniqueness. 
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Definition 2.1. In the compact case, a function u is said to he a solution to (|2.2|) if, for any 

positive T , 

• u belongs to L°°((0, T), L2(T'')) fl ]L^((0, T), (T'')) ; 

• for any function ip £ EI"'"(T''), we have: 

dt I uti} = ^ I UiVl/-Vi/)- / VitfVV'+ / ut'^^diii, (2.3) 

in the sense of distributions in time ; 

• Jio = po • 

In the non compact case, u is said to be a solution to (|2.2I) . if, for any positive T , 

• u belongs to L°°((0, T), L2(iu)) fl L^((0, T), (u>)) ; 

• for any ip {w) 

dt I uttpw^- I UtW-iwV^p + tpVw)- f \/ufiw\7ip + tp\7w)+ f ut^^^^{dii))w, (2.4) 

holds in the sense of distributions in time ; 

• uo = po ■ 

Notice that (12. 3|) is a variational formulation of (|2.2|l in the space L^(T'*) and that IS a 

variational formulation of 1)2. 2[) in the space L^(w). 

These conditions make sense. Indeed, in both cases, the conditions on u and ip are such that 
the variational formulations (|2.3p and (|2.4p are well defined (notice that one has IVui] < Kw). 
Moreover, for the compact case, if u lies in L^((0, T), (T'*)), and satisfies (|2.3|l then dtu lies in 
L^((0,T),e"^(T'')), so that (see [H page 23]) u lies in C{[Q,T],1?{T^)), allowing us to define the 
value of u at time t = Q. The same argument holds for the non compact case. 

2.1 Existence of regular densities for solutions to the nonlinear 
equation 

In this section, we consider a solution X to Equation and we denote by Pt the law of {Xt}. We 
show that Pt has a density pt, and that p is a solution to Equation (|2.2|l . in the sense of Definition l2.1l 

Lemma 2.2. Consider both the compact and the non compact cases. Under Assumptton [3 for 
any t > 0, Pt admits a density pt with respect to the Lebesgue measure satisfying the following mild 
representation 

Pt = Gt ★ Po + ^ VGt^s * (Vyp,)ds - ^ diGt-s * ds, (2.5) 

where Gt is the density of \/2 times the Brownian motion on T), namely 



^ ^ i. c 



e 4* 



for the non-compact case, and 



for the compact case. 
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Proof. Let x be a smooth function with compact support on T X R''"^ and T > 0. Then, for 
t £ [0,T], the function tp defined by 

is the unique smooth solution to the following problem 



dstp = -AV- on (0,t) X T X R''-\ 
i/)t =x onTxR'*"^ 

Computing ^ps{Xs) by Ito's formula and using (|2.6|) we get 

[ lAtdPt = [ iPodPo - [ [ A'tPsdPsds + [ [ AxPsdPAs 

Vt/', ■ Vl/dP,ds + / / diips^^dPAs 



(2.6) 



iTxE^-l io iTxl''-! P. 

TpodPo- [ [ VtPs-VVdPsds+ [ [ di4:s^^dPsds. 
Using the expression of i/'t and Fubini's Theorem, we have: 

/ xdPt= [ x(Gt*Po)+ f xf VGt-s*iPsVV)ds 



I -I 

JTxK<'-l JO 



X I diGt-s * (^^Ps ) ds. 



This last equation being true for any smooth function x with compact support, then Pt is given 
by the right-hand side of (|2.5|) . which is an integrable function, so that for any positive t, Pt has a 
density Pt satisfying (|2.5p . □ 

In regard of the following lemma, p necessarily satisfies some integrability conditions. 

Lemma 2.3. In both the compact and the non compact case, under Assumvtions\^ and\ii[ p lies in 
L°°((0, T), L'^(I')) for any T > 0, and we have ||p||l°°((o,t),l2cd)) — where C is some constant 
only depending on Po, W and T. 

In the non compact case, under Assumptions \^ [m| and\u^ p lies in L°°((0, T), L^(w)) for any 
T > 0, and we have a bound ||p|lL°'((o,T).L2(tu)) < C, where C is some constant only depending on 
Po, VV and T. 



We only give the proof of Lemma [2.3l in the non compact case, the one in the compact case being 
similar. 

Proof. The mild formulation (|2.5p will allow us to prove that u € L°°((0, T), L^(u!)). Since po lies 
in both L^(w) and L'^(u;), it lies in Lfl{w), for any 1 < q <2. We first prove that we have a uniform 
in time estimate in h''{w), 1 < q < 2, for pt. 
From equation (|2.5p . it follows 



||pt||L9(™) < IIpo|1l<!(u,) + / llvCt-s ★ {'VVps)\\l<,(u,) + 

Jo 

It holds, from Jensen's inequality, 



diGt-s * ( ^"i— P< 



ds. (2.7) 
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\\\7Gt-s*{\/Vps)\\Lr.... <K 



/txR''-1 



/ \'VGt-s{y)\''Ps{x - y)w{x)dxdy. 

1 iTxK'i-l 



Now, notice that w{x) < K{1 + \y^'"'^\^^)w{x — y) = n{y)w{x — y), so that 

WVGt-s * {VVps)\\l,^. <K f f \VGt-s{y)\''Ay)Ps{x - y)w{x ~ y)AxAy 

=if||p.||Li(^,) / \VGt^s{y)\''^{y)Ay. 

In view of Lemma ll.ll ||Ps||Li(m) is bounded. Moreover, one has for < s < t < T, 

<? 



\VG...{y)\^.[y) = YA.[t-s))-^'-Y.- ^"'^^-^^ ^ ' -^-'''^^^ 



fcez 



2(t - s) 



- s)'j('*+l)/2 



2...d|2A/(3 



y — kei\ Iv-kcil 



Then, since a function / with polynomial growth satisfies f{x)e ^ < Ke ^ 1"^ for some constant 
using Holder's inequality, we deduce. 



|VGt_.(t/)lV(y) < 



K 


(t- 


g)<j(d+l)/2 




K 


(t- 


g)<7(d+l)/2 




K 


(t- 


g)<j(d+l)/2 



fcez 



g 16(t-s) 

feez 



g 16(t-s) 



where q' satisfies ^ + ^ = 1. Consequently, it holds, for < s < t < T, 



( f |VGi_,(y)lMy)dy') 



(t _ s)(d+l)/2-d/29 • 



(2.8) 



The last term in (|2.7|l can be bounded in the same way, so we deduce that \\\/Gt~3*(VVps)\\!Lq(m) + 
9iGt_s * I 1 Ps I ds is finite as soon as 

II V Pa / ilL<! 



l<q< 



d 



d- I 



(2.9) 



In view of ^J\, p lies in L°°((0, T), L''(T x R''"^)) for all T and all q satisfying and we have 

a bound on its norm depending only on Pq, Vl/ and T. We now bootstrap this estimate to reach a 
uniform-in-time {w) bound for p. 
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Let no be an integer large enough so that 



no + 1 ^ d 



no + 1/2 d-1' 

and define for n = 0, . . . no, q — ,^"^"^^2 ^^'^ ~ ( ? ^ ( ? ^ ^) ) ' ^^^i*^^ that {qn)n=o...no 
satisfies qo = q, qng ~ 2 and 

1 1 1 

1 + = — + -, 

qn+i qn q 

so that, according to Young's Inequahty, convolution continuously maps L'" x L' to L''"+i. Conse- 
quently, we have for n < no 



||VGt_.*(Vl^p.)|L..+i(») <K(f {\VGt-s\^Psy"+'{x)w{x)Ax\ 



=k[\ I \VGt-s\{v)ps{x-y)dy) w{x)dx) 

We have w{x) < ■w{x — y)'n{y) < 'w{x — 2/)''"+^''''"7r(y), since g,i < g„+i, yielding, by Young's 
inequality and the polynomial growth of tt. 



1n, + l \ 1/971 + 1 



||VGt-.*(Vyp.)||i.,„+i(„) <k( f ( f \VGt-s\{y)n{y)'^''"+'ps{x ~ y)w{x ~ y)'^''-dyy"^' dx) 



<K\\\\/Gt-s\TT '^''" + MlL9{TxB''-l)b^lll-<!"(») 

K 

-(f _ s)(d+l)/2-d/{29) IIPs|IWr.(u,)- 



the last inequality being proved in the same way as (|2.8|l is. As a result, for n < no, 

||Ps||L9n(u)) 



IbtllL'^+Mu,) < bo||L«" + l(™) +^ 

Jo 



-ds. 



By induction on n, since -^^^ — ^(d+r)/2-d/(2q) integrable on [0,t], this estimate shows that p lies in 

L°°((0,T),L^(u')), for all positive T. Since we control sup^gjo.T] l|Pt||LTO (u.) by a constant depending 
only on Po, and T, we also have such a control on sup^gjQ ||pt||L2(m)- 

□ 



Now, we prove that p is a solution to Equation (I2.2|l in the sense of Definition 12.11 First, we 
show that it satisfies the regularity condition. 

Lemma 2.4. In the compact case, under Assumvtions\l\ andUil one has 

p G L°° (^(0,T),L^(T'*)) P|L' (^(0,T),tf(T'*)) . (2.10) 

Moreover ||p||l°°((o t) l2(t<')) + IIpIIl2{{0 t) h1{t'')) — ^> where K only depends on W, Po Oind T . 
In the non compact case, with the additional Assumptions^ one has 

p G L°° ((o,T),L^H) f|L^ ((o,r),e^H) . (2.11) 

Moreover ||p||l°o((o,t),l2(iu)) + l|p||L2{{o,T),Hi{m)) where K only depends on VV, Po and T. 
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Proof. According to Assumption [nl po lies in L'^(I?). Consequently, from Lemma 12.31 we know 
thatPt has a density pt suchthatp G L°°((0, T), L^(0)). We now prove that p lies in L^((0, T), (D)). 
We know that p lies in L°°((0, T), L^(0)) C 'L\{Q,T),l?{V)), and that £^ is in L°=([0,r] x V), 
so that the function / defined by 



/ = div(pVV^) - 9i {^^P 

lies inL^((0,T),]HI"^(D)). Consequently, it can be shown, for example using a Galerkin approxima- 
tion (see [6l Chapter XVIII]) that the problem 

dtv-^v = /, 

vo = Po, 

admits a unique weak solution v in the space L°°((0, T), L^(r>) f] L^((0, T), (O)). Here, "weak 
solution" means that for any tp in 11^(1'), 

dt I ^pvt+ [ V^Vvt = [ (2.13) 

holds. Thanks to an a priori estimate, we can find a bound K depending only on VV, Po and T, 
such that this weak solution lies in the ball of radius C in the spaces L°°((0, r),L^(D)) and 
L2((0,r),H^(©)). For the non compact case, notice that under Assumption [ml / satisfies for 
any £ (w) , 



/ pW -Viipw) ~ '——pdii^w 

<K / \p\/Tp\w + K \pip\w 



<K\\lp\\BHn,), 

the last bound being deduced from Lemma 12.31 From the following a priori estimate, 
7;dt\\vt\\l2(^)= - I \/vt'V{wvt)+ I fvtw 

<-/ \Vvt\'^w + K \vt\/vt\w + K\\vt\\m^^-) 

< - ^l|Vi't||L2(t„) +-K'lkt||L2(u,) +K, 

standard arguments show that v also lies in L°°((0, T), L^(it))) fl L^((0, T), (w)), if po £ L^(u)). 

We are now going to show that v is actually equal to the function p. For a fixed t in [0,T], 
consider tps = Gt-s *X, solution to the problem (|2.6|) . where x is some test function, and compute 
da Jj^tpsVa. From [T71 page 261, Lemma 1.2], we obtain 

da / IpaVa = / Ipaf, 

in the sense of distributions. Using the expression of tpa, this equation rewrites 

ds / {Gt-s*X}Vs= / {Gt~a*X)f, 
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which is equivalent to 

f x{Gt-s*v,)^ f xiGt-s*f). (2.14) 

J-D J-D 

Since V G h'^{{0,T),m\V)), and dsV G L2((0, T), H'^ (©)), then v lies in C((0, T), L2(0)) (see [6l 
Chapter XVIII, §1, Theorem 1], so that the left hand side in (|2.14p is the derivative with respect ot 
s of a function which is continuous in s. Moreover, one has 

(9iV \ 

so that the right hand side in (|2.14p is integrable in time. Consequently, integrating on [0,t], one 
finds 

XVt= f x{Gt*Po)+ [ r x{VGt-s*{VVps))ds- f r x(diGt-s*(^Ps))ds. 

I'D J-D J-D Jo J-D Jo \ \ Ps J J 

Identifying in the sense of distribution, one has 



vt = Gt ★po + ^ VGt-s * {VVps)ds - diGt-s * (^P'') ^s- (2-15) 



The right hand side in (|2.15|l is exactly the right hand side in (|2.5|) . and (|2.15|l holds for all t > 0, 
so that V = p, and the regularity we wanted on p actually holds. 

□ 

We finish this section by proving: 
Lemma 2.5. The function p satisfies Equation (|2.2|l in the sense of Definition \2.l] 

Proof. According to Lemma [2.41 in the compact case (resp. in the non compact case), for any t > 
0, p lies in L°°((0,T),L2(T'*)nL2((0,r),ei(T'*)) (resp. in L°°((0, T), L2(w) fl L^((0, T), H^(w;)))- 
Moreover, thanks to Ito's Formula, p satisfies Equation (|2.ip for any smooth test function ^. But, 
according to the regularity of pt, and by the density of smooth functions in H^(T'*) (resp. in ]HI^(w)), 
Equation holds for any -tp in H^(T'') (resp. holds for any V in H^(io)). This means that 

pt is a solution to (|2.2|1 in the sense of Definition 12.11 □ 



2.2 Uniqueness results 

In this section we prove that uniqueness holds for solutions of Equation 1)2. 21) in the sense of Defi- 
nition [2TT1 yielding uniqueness for solutions of the nonlinear equation p.l[) . 



2.2.1 Uniqueness for the Fokker-Planck Equation 

Theorem 2.6. In the compact case, under Assum-pttonsH and\vi\ or in the non compact case under 
Assumvtions\i\ [nl and [ml uniqueness holds for the solutions to the Fokker-Planck equation (|2.2p in 
the sense of Definition \2. l\ 

Proof. We only give the proof in the non compact case, which can be adapted straightforwardly 
for the compact case by performing the same computations in the space L^(T''). Let u and v be 
two solutions of (|2.2p in the sense of Definition 12.11 with same initial condition no = vq. We use 
Gronwall's Lemma to prove that ||itt — ut|lL2(^) = for all t > G. Adapting the proof of | 17| page 
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261, Lemma 1.2], one has \dt\\ut — ftH ^2(^,) = J^^^d-i {ut — vt)dt(ut — vt)w. Consequently, since 
and i; satisfy Definition 12. 11 and using (|0.5p and Assumption |il it holds that 

^dt\\ut - ut||L2(„) < K\\ut - ■ut||L2(„) + K\\ut - vt\\i^2^^^\\\/ut - Vt;t||L2(^,) - ||Vitt - \7vt\\l2(^^) 



+ / d\{ut — vt)[ut ^\ 



- Vt- 



We want to estimate the last term. Notice that, thanks to Lemma [l.2l u = w , so that 



d\(ut - Vt) I Mt-^ 



dlV 



Vt- 



diV a^v 
di(ut — vt)ut J w 



+ 



dlV 



di{ut - vt){ut - ut)-^ 



Since diV is bounded, the second term in the right-hand side is smaller than 

K\\ut - t't|lL2(„) II Vitt - Vt;t||L2(„), 
and the first term is smaller than 



\\Wut - Vut||L2(„) 



1/2 



Then, 



7 f^)'(-^"--r)^ 



1/2 



< 



(tit) w 

d-1 

^t|lL2(™)- 



1/2 



L°°(T) 



The function t ||itt ||l2{u,) is bounded on [0, T], and, thanks to Lemma [1.2 1 Assumption [n] and the 
maximum principle, is bounded from below by some positive constant, so that 

1/2 

< K\\uf^^ - ufl^llLoefT). 



iTxKi-i \nj ^ ' ) 



To conclude, notice that, for any positive 7, ]HI^''^^^(T) continuously imbeds in C(T) (see [Jl page 
217]). Consequently, interpolating H^(T) and L^(T) (see [131 Page 49], we obtain for a function / 
in ei(T) and7G (0, i). 



II/I1l=»{t) < ^I1/I1mi/2+.(t) < ^ll/llL2(T7ll/llHim"- 

All the previous inequalities give us 



(2.16) 



l|wt -"t|lL2(u,) + l|Vut - Vut||L2(^) < K\\ut -i;t||i^2(„)||Vut - Vut||L2(„) -^K\\ut -Ut||L2(™) 



^K\\u° 



dxV SiV||l/2-7|| SiV 9iV||l/2-|-7 



Il2(t) 



"t' IIh1(T) ll^^t ~ Vut||L2(„). 



We finally obtain, from Lemma lO. II and Young's inequality ah < ea^ + q ^(pe) ''^^iP , holding true 
for any positive a, b, e, p and q such that - + - = 1, 



dt\\ut - ?^t||L2(„) + ||Vut - Vt;t||L2(„) < K\\ut - i't|lL2(„), 
yielding uniqueness through Gronwall's lemma. 



□ 
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Remark 2.7. A more natural uniqueness proof can be performed, using an entropy estimate. In 
particular, this proof does not require the introduction of the weighted spaces. Unfortunately, it does 
not apply to the solutions in the sense of Definition \2.l\ Uniqueness actually holds tn the subspace 
of functions such that the following computations make sense. 

Let u and v be two solutions of H2.2|) with same initial condition uo = vq. Notice that from 
Lemma M.'A the functions and are equal. Define the relative entropy of u with respect to v: 

E{t)^ I nlog-. 
// all quantities involved are finite, it holds that 



E'{t) = dt( f A + f dtu log- - f dtv - 

= 0-/ uVFVlog / ViiVlog-+/ u — ^9ilog- 

vVVV-+ VvV / V — —di- 



2 



V-1 + / in'-'' -v'-"") 4^1- 



But, using Csiszdr-KuUback inequality, it holds 



I 

JTxR<* 



f div aiv\ 1^ ^ 

-1 V J 







9i 


u 1 II 


1 


V 




JTxV. 


d-1 1 




u 1 In 




V 






/TxR 


d-1 







<K / v\di-\ / —log- 



^ X 1/2 



In conclusion, we find 

E'{t) <-( ^1\v^\\k([ ^ \dA"\'' {E{t)r' . 
We can conclude the proof using Young's inequality and then Gronwall's Lemma. 
2.2.2 Uniqueness for the nonlinear process 

Theorem 2.8. Pathwise uniqueness and uniqueness in law hold for Equation in the compact 

case under AssumvtionsH and\vil and in the non compact case under AssumvtionsUl [mI andUvH 

Proof. As stated in Lemma 12.51 if X solves (|l.ip . then {Xt} admits a density pt such that p 
satisfies (12. 2|) in the sense of Definition [27l] Thus, in regard of Theorem 12.61 pt is uniquely defined. 
Consequently, Equation (II. If) rewrites 

dXt = ( -VV(Xt) + ^'' [5*^ ei I dt + V2dWt, (2.17) 



where pt is the unique solution to Equation (|2.2|l in the sense of Definition [2TT] Notice that the drift 
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in Equation (|2.17|) is bounded, so that pathwise uniqueness holds (see [9]), as well as uniqueness in 
law, from the Girsanov Theorem. □ 



3 A regularized approximate dynamics 

To estimate the difference between the nonlinear process defined by Equation p.ip and its particle 
approximation (|1.3p . we introduce an intermediate process, called the regularized nonlinear process, 
which is the natural expected limit as N goes to infinity of the particle approximation (|1.3|) . The 
nonlinear term in this equation is more regular than the one in ({l.t |) . so that we can show existence 
and uniqueness for this process. 

The aim of this section will be, in a first time, to prove existence and uniqueness for the regular- 
ized nonlinear process, see Theorem l3.1l and in a second time to show that the regularized nonlinear 
process converges to the nonlinear process solution to (jl.ip as e and a go to zero, and to estimate 
the rate of this convergence, see Theorem 13.111 below. This will yield an existence result for the 
nonlinear process. 

Under Assumption |iv] on the initial condition, for a fixed positive integer n, we expect the 
sequence of processes (XJJ jv)iv>o defined by (II. 3|) to converge to a solution to 

< \^ fv*Pt J (3-1) 

[ Pj" = distribution of {X^^„} 

with initial condition (Xo,n). 



3.1 Existence and uniqueness for the regularized problem 



In this section, we show that pathwise uniqueness, uniqueness in distribution and strong existence 
hold for the regularized dynamics. 

We first show existence and uniqueness of a solution to (|3.1|l . using a fixed point method. 

Theorem 3.1. Consider both the compact and the non compact cases. Under Assumvtions\i\ andlvi^ 
strong existence and uniqueness hold for Equation (|3.ip . 

Here we follow [15J: we show that a measure on the space of continuous paths from [0,T] to 
R'* is the law of a solution to p.l|l if and only if it is a fixed point of some function "1>t. Then 
we show existence and uniqueness of this fixed point by a contraction argument. This cannot be 
done directly for Equation (|l.ip . since its nonlinear term is too ill-behaved, so that we do not have 
contraction in that case. 

For a probability measure fi on the set Ct = C([0,T],R ) we denote by $t{)J-) the distribution 
on Ct of the process X defined by 



dXt 



( 



V 



-VV{Xt) + 



ip,^{Xl - xl)diV {xt)d^{x) \ 



fvi^t - xj)dfi{x) 



-ei 



dt + V2dWt 



(3.2) 



whose initial condition Xo has law Po and is independent of W. The distribution ^T{fJ,) is well 
defined since Equation p.2|) . having global Lipschitz coefficients, has a unique strong solution. 
Notice that, since 

Ict " xl)diV{xt)dfi{x) 



^^ V 
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jj, is the distribution of a solution to (|3.ip up to time T if, and only if <1?t(m) ~ We will show 
that such a /x exists and is unique using Picard's Theorem. 

The Wasserstein metric Dt{ij.i, fJ,2) between two probability distributions and ^2 on Ct is 
defined by 

-Dt(mi;M2) = inf / 1 A\\x ~ y\\cTd'^{x,y), 

where 11 = {tt € ViCr x Ct), tt having /ii and ^2 as marginal distributions} is the set of all cou- 
pling of /ii and jU2, and ||.||ct is the uniform norm on Ct'- 

Wf^gWc^^ sup \f{t)-g{t)\. 

ie[0,T] 



More generally, for t G [0, T], we set 



Dt {^1,^2) = inf 



lA sup \xs — y3\dn{x,y). 

Ct^Ct s6[0,t] 



Endowed with the Wasserstein metric, the space 'P{Ct) of probability measures on Ct is complete. 
In order to apply a fixed point argument, we will need the following contraction lemma. 

Lemma 3.2. Consider both the compact and non compact case. Let T be a positive time. Under 
Assumption^ there is a positive constant K , not depending on t, satisfying 

A($T(Ml),*T(At2)) < / Ds{^ll,ll2)ds, 

Jo 

for all t in [0,T] and for all probability measures fj,i and /12 in V{Ct). 

Proof. Let ^1 and jj,2 be two probability measures on Ct- For i = 1,2, define Xt,i by 

ei 



dX, . = 



-\/V{Xt,^) 



V 



dt + ^dWt 



J 



with given initial condition Xo.i = Xq, for i = 1,2. 
Notice that 

Sct 'fivi- - xl)diV{xt)d^i{x) _ * /ifi/ 



Ic-r Vvi- - ^DdM^) 



(3.3) 



and that from (|f .4|) and Assumption IT] the numerator and the denominator of l|3.3|) are respectively 
bounded from above and from below by positive constants depending only on 77 and V. Then, for 
any x, y and < s < T, 



diV diV 



<K{\x-y\Al + Ds{m,fi2)). 



Consequently, 

E[ 

for all t <T. Using Gronwall's Lemma, we then find, for any t < T, 



[1 A \\X^ - X2\\c,] < K (^J^ E[1A -X2|lcjds + ^ , ^2)ds^ , 
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E[1A ||Xi -XallcJ < A- / Ds{^il,^^2)ds. 

Jo 

But 

Dt(<l>t(/ii), $t(M2)) < E [1 A ||Xi - XallcJ 
since Xi and X2 respectively have and 'l>t(/i2) as distributions, finishing the proof. □ 

Proof of Theorem \3.1\ Iterating Lemma 13.21 we find existence and uniqueness of a fixed point of 
$T, given Xo, which yields uniqueness of the distribution P of the solution to (|3.1|l on [0,T]. 

The law P of any solution being unique, we can substitute the marginal of P at time t in 
Equation (|3.ip . and we obtain a linear stochastic differential equation with Lipschitz continuous 
coefficients. Pathwise uniqueness holds for that kind of equation, so that weak existence and path- 
wise uniqueness hold for (|3.1|l . Consequently, from Yamada-Watanabe Theorem, it admits a unique 
strong solution. 

□ 

3.2 Convergence to the nonlinear process 

We are now going to let e and a go to in (|3.1|) . 

We denote by the unique strong solution to (|3.ip . with initial condition Xq and Brownian 
motion W" replaced with W. The distribution of {X^} will be denoted P^ . We expect a possible 
limit X of X^ as 77 goes to to be a solution to To this aim, we define the following martingale 

problem: 

Definition 3.3. We say that a probability measure P on the space Ct of continuous paths is a 
solution to the martingale problem associated to (jl.ip if its time marginals Pt admit a density pt 
with respect to the Lebesgue measure, and if, under the measure P, 

• the canonical process x G Ct is such that for any twice differentiable function which is bounded 
as well as its first and second derivatives, the process 

mt = i;{xt) - i^{xo) + f \7i;{xs)\7V{xs)ds~ f Aij{xs)ds- f dii>(xs f \ ds, (3.4) 
Jo Jo Jo Pt(xt) 

is a martingale with respect to the filtration a{xs,s < t). 

• {a;o} has law Pq. 

Notice that, since the drift coefficient is bounded, the Girsanov theorem shows that it is not 
restrictive to assume that Pt has a density. 

We deduce from Theorem l2.8l the following result: 

Proposition 3.4. In the compact case under AssumvtionsH andUil or m the non compact case under 
AsumvtionsUl [mI andUiii uniqueness holds for the martingale problem defined in Definition \3.3[ 

Our aim in this section will be to prove the following results: 

Theorem 3.5. Let Assum'Dtions\^ and\i^ hold. 

In the compact case, {P^)ri>o converges as rj goes to to the solution of the martingale problem. 

In the non compact case, the family of probability measures (P''),,>o is tight, and any converging 
subsequence converges to a solution of the martingale problem defined m Definition \3.'J[ Under the 
additional Assumption \iiH {Prj)r]>o actually converges to the unique solution. 
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As a corollary of Theorem 13.51 one has existence of solutions to (under regularity assump- 

tions on the initial condition). 

From Proposition 13.41 in order to prove Theorem 13.51 it is enough to prove that the family 
{P^)ri>o is tight, and that any converging subsequence converges to a solution of the martingale 
problem. 

Our first step will be to derive the Fokker-Planck equation satisfied by the distribution of {X^}. 
Let V be a smooth bounded function on T>, with bounded derivatives. Applying Ito's formula to 
ip{X^) and taking the expectation, we find that 

/ VdP^= / ippo{x)Ax+ / / ( At/) - V?/> ■ V V) dPi^dt + / / diip'^ ^-^AP^^At. (3.5) 

J-D JT) Jo JT) Jo Jt) (pn * Pf ' 

Equation (|3.5|) is a weak formulation of the following partial differential equation 

ap," = div (p," vv^ + VP,") - d, (pt^ '^''*^Ci 1 ■ (3.6) 

We are going to show that P^ , or more precisely, its density, is actually a solution to equation (|3.6[) 
in the following stronger sense. 

Definition 3.6. A function u is said to he a solution to (|3.6p with initial condition po if, in the 
compact case, 

• u belongs to L°°((0, T), L^(T'*)) fl L^((0, T), (T'')) ; 

• for any function tp £ H^(T'*), we have: 

dt [ uti} = - [ utVV-Vi}- [ \/ufV^+ [ {dii>)ut '^'' * (3.7) 

J-D J-D Jt) Jt) Vv * 

in the sense of distributions in time ; 

• uo = Po . 

In the non compact case these conditions are replaced by 

• u belongs to L°°((0, T), L^(m)) f] 1L^((0, T), H^(w;)) ; 

• for any function tp G M^{w), we have: 

dt [ uttpw = - [ utW ■ {wVtp + -tpyw) - I Vut ■ {wVtp + tpVvu) + I {ditp)ut '^'^ * ^\ w 
Jt> Jv Jt> Jt> Vi * 

(3.8) 

in the sense of distributions in time ; 

• uo — po- 

As for Definition [27l] these conditions make sense. 
With this definition, one has the following result: 

Lemma 3.7. Consider both the compact and the non compact cases. Under Assumvtions\i\ andlvii 
the distribution P^ of {X]^} has a density p^ with respect to the Lebesgue measure such that p^ 
satisfies (|3.6p m the sense of Definition \3.(^ 

Moreover, the family {p^)r,>o ^s bounded in L°° ((0, T), L^(©))nL^((0, T), E[^(I>)) and, in the non 
compact case, under Assumption]^ {p'^)v>o bounded in L°°((0, T), L^(w)) n L^((0, T), H'' (it;)). 
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t ?7,1 



Proof. Since the drift coefficient in (|3.ip is bounded, following the proof of Lemmas 12.31 and l2.4l we 
obtain that has a density p^, where p^ satisfies the first condition in Definition 13.61 Applying 
Ito's formula to tf}{X^) for some smooth t/j, we find that H3.7I) f (l3.8l) in the non compact case) holds 
for a smooth ip. Using the density of smooth functions in M^{T x R''^^), it holds for any in 1^(1"^), 
and the same is true for H^(w) in the non compact case. 

To prove that p^ is bounded independently of rj, notice that from the boundedness of W, 

the function i is bounded from above uniformly with respect to ri. Consequently, from 

Cauchy-Schwarz inequality, 

^3t||p?||L2(TxE<i-l) = - I|VP?||l2(Tx1''-1) ^ / P?Vp? -W + (dlPt)Pt 

< - l|Vp?||L2(Tx«'i-l) + -^IIP?IIl2(TxK<'-1)I|VP?||l2(TxK<'-1)- 

where, the constant K does not depend on rj. We finish the proof using Young's inequality, and then 
Gronwall's Lemma. 

The proof is similar in the non compact case. □ 

Thanks to Lemma [3.71 we can prove the relative compactness of the family p^ in a nice sense. 
Lemma 3.8. Consider both the compact and the non compact cases. Under Assumvtions\i\ ararfRtl 
for any hounded open domain O in T>, the set {p^ \o)ii>o "/ restrictions of the functions p^ to O is 
relatively compact m the space L^((0, T), L^(C')). Moreover, the set {P^)n>o of laws of the solution 
is tight. 

Proof. We first prove the relative compactness of p^ in L^((0, T), L^(0)). We use the fact that for 
a bounded open domain O and for p,q £ (1, oo), the space 

Ep,q = {f G Lf((0,r),H'(O)), such that dtf G h" {{0,T),M'' (O))} 

imbeds compactly in L*'((0, T), L^(C')) (see |12i page 57]). We already know that the set (p'^)n>o is 
bounded in L^((0, T), H^(r))), so that the set (p''|o),,>o is bounded in L^((0, T), e^(0)). Thus, it 
is enough to show that {dtp^ ^q)-^>o is bounded in L''((0, T), ]HI~^(0)), for some q G (l,oo) to finish 
the proof. The following equation holds 

dtp" = div(p''vv) + Ap" - di (p^^EnlPl^ 

\ 'Pv* Pt' 

showing, since (p''),,>o is bounded in L^((0, T), (C)), that (dtp'^)n>o is bounded in h'\{0,T),W'^{V)), 
thus, dtp^ is bounded in L^((0, T), EI~"'^(0)). This shows that (pJ'(p)r)>o is relatively compact in 
L2((0,r),L2(O)). 

Now we prove the relative compactness of {P")r]>o in 'P{Ct). For this aim, we use Kolmogorov 
compactness criterion. At time t — 0, Xq is equal to Xo, independently of r;. Consequently, the 
family (Xq ),,>o is tight. To conclude the proof, it is enough to show that for some positive constants 
a, b and K, 

supEOXt" <K\t-s\^+'' 
for < s,t < T. Since W is bounded, we have, for < s,t < T and p > 1, 



E[\Xl' ^ X:!]"]^^" <E j\viX:^)dT'' +E[\Wt-Ws\''Y^'' + E 



Pt 1/p 



<K[\t-s\ + \t- s\^''^ 
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This rewrites 

E[jX,''~X:y] <K\t-s\'''^, 



for some positive K. Taking p = 3, Lemma 13.81 follows. □ 



As a consequence of Lemma 13.81 using a diagonal argument, we can extract a subsequence of 
— > 0, still denoted rj such that: 

• p'' converges almost everywhere on (0,r) x V and in L2((0, T), L^(C')) = L^((0,r) x O) as ?7 
goes to 0, for any bounded open domain O to a function p°. 

• converges in 7'(C([0, T])) as 77 goes to to a probability measure . 

To let 77 go to zero in (|3.ip . we finally need the following lemma. 

Lemma 3.9. Consider both the compact and the non compact cases. Under Assumvtions\i\ andUil 
the limit of p^ is such that pt is the density of the time marginal of P" for almost all times t. 
Moreover, the convergence of p^ to also holds m L^((0,r) x D) and up to a second subsequence 

in *p'''^l^ p°'^l^ 

extraction, — — j— converges almost everywhere on (0, T) x T to — — as r) goes to zero. 



Proof. We first prove that p'' converges to p° in L^((0, T) x V). It holds 

r / = r / (p"-p°)+2 r / (p^-p^) 

Jo JT) Jo Jt> Jo Jt> 



= 2 (p^^pY- 
Jo Jt) 

But p^ converges almost everywhere to p", and (p'' — p°)~ is bounded from above by the integrable 
function p". Consequently, by the Lebesgue theorem, p^ converges to p" in L^((0,T) x V). 

A consequence of this convergence and of the boudedness of V is that the sequences (p'''^^^)i7>o 
and (p'''^),,>o converge in L^((0,T) x T) respectively to p^'^^^ and p°'^ 

As a consequence, tp,^ *p'''^ and ipri * p^'^''-^ also converge in L^((0,r) x T) to the same limits. 
Therefore, up to the extraction of a second subsequence, we have pointwise convergence almost 

everywhere for the denominator and the numerator of — 



V7^*p'''i 

Now we show that p? is for almost all t the density of the time marg inal Pt" of P°. bmce P ' 
converges to P° as rj goes to in V{Ct), then E [^'(X'')] converges to E ['1/(X'')] as 77 goes to 0, for 
any bounded continuous functional on Ct. Taking a function of the form ^'(V) = 6{t)^{Yt)At 
where ^ and 6 are bounded and continuous, one has 

E[*(x'')]= r^wf / ^p^'jdi. 

Jo \JtxR''-i / 

Moreover, since p^ converges to p" in L"'^((0, T) x T X R'*"^), one has 

r (e{t) I ^pi) At ^,^0 r e{t) ( I *p? 



At. 



As a result. 



E 



T 



l{t)^{X'i)At 



m ( I ^pi] At, 



SO that, almost everywhere, p? is the time marginal of P'^. □ 
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We can now prove Theorem 13.51 We want to prove that P° is a solution to the martingale 
problem defined in Definition 13.31 It is enough to show that for < si < . . . < s„ < s < any 
bounded continuous function g and any twice differentiable function with bounded derivatives, 
one has /^^ g{xsi, ■ ■ ■ ,Xs„){mt — ms)dP° = 0. 

Under the probability measure P'' , the canonical process x £ C([0, T]) is such that 



m'i ^ ip{xt) ~ tpixo) ~ / Ai){x^)ds+ / \/V{xs)Vip{x 



s)ds - / di^(xs 
Jo 



ds 



is a martingale. We thus have 



g{xsi,. . . ,Xs„){m'i - m^)dP'' = 0. 



Consequently, denoting fj — (e, a) 



7(xsi, . . . , Xs„){mt - ms)dP' 



g{xsi,. . .,Xs„){nil - rnDdP"^ 



Ct 



[ ff(x,,,...,a;,J(m?-mf)d(P''-pO) 
Jct 

/ ^(xsi, . . . ,X3„)((m^ - m^) - (mt - ma))dP° 
Jct 



Taking limsup^_>Q limsup^_>Q, we obtain: 



g{xsi, . . . ,Xs„){mt — ms)dP < Um sup lim sup / g{xs-^, . . . ,Xs„){m'^ — m]!)dP'^ 



(3.9) 



Indeed, (/(a;^^, . . . , Xs^){rnl — mf ) is a bounded continuous function of x, and P'' converges to P". 
Moreover, we have 



l{xsi,. . . , Xs^){{rnl - ml) ~ {mt - ms))dP° 



Ct J a 



g{x, Xs2)dltp{Xr) 



rj.l 



0,1 



(xl) dr dP°{x) 



<K 



(y) 



Priy) dy dr. 



This last integral goes to as 77 goes to 0, since the function 
everywhere to on [s,t\ x T>, and is bounded fom above by some positive constant. To conclude, 



TJTT"" 



converges almost 
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we estimate the right hand side in p. 91 



gixsi,- 



. ,a;„.)((m? - m?) - (m? - m^))dP''(:c) 

T7,0i V 



<K 
=K 



g{Xs-,,...,XsJ / diip{xr 
J s 



<Pv *Pt 



ipfl * p. 



ipn * Pt 



<Pr, *P. 



dP''(T)dr 



<Pv *P?' (y) V^i; *Pt' {y) 



Pt' iy)dydT. 



{xl)dTdP''{x) 



This last integral tends to as 77 and rj go to 0, since p'''^ converges in L^((s,t) x T), and since 



'fiv *Pt 



77,81 V 



(y) v'^i * p 



(y) 



v>v*PT'^{y) 

Theorem E31 



^ii *Pr' iy) 



is bounded and converges almost everywhere to 0. We then obtain 



3.3 Another existence result for the nonhnear process 

From Theorem 13. 5 1 we know that existence holds for under some regularity assumptions on the 
initial condition. Indeed, if is the limit of some subsequence of P^ , then the canonical process x 
defined on the canonical space (Ct, f*") is a solution to Equation (jLlf) . By approximating the initial 
condition by regular densities, one can relax the regularity assumption. 

Theorem 3.10. Consider both the compact and non compact cases. Under Assumption\^ weak 
existence holds for Equation (II. ip with given initial condition Xq. Moreover, for positive s, the law 
of {Xs} has a density pg such that, for < t < T , 

pGL°°((t,r),L^(o))f|L^((i,r),tf(o)). 

Notice that, under the hypotheses of Theorem 13.101 we have no uniqueness result. 

Proof. Theorem |3]5] yields existence for (jl.ip when the initial condition satisfies Assumption [ul To 
prove existence without assumption on the initial condition, we use approximations of the initial 
condition. Let (po)feeN be a sequence of probability densities satisfying Assumption |u] and converging 
to p° in V{T>) (for example, this sequence can be obtained by convolution with a gaussian kernel). 
From Theorem 13.51 there exists a solution {Xt) to Equation (|l.l|l driven by a Brownian motion W 
defined on some probability space (f2, J^, P), such that Xq admits Pq as density. 

As in the proof of Lemma[3]8j we can apply Kolmogorov criterion, so that the family of distribu- 
tions P^ of ({Xt*}) o<t<T is tight. Consequently, we can extract from (P ) a converging subsequence 
whose limit is denoted P. To prove that P satisfies the martingale problem defined in Definition l3.3l 
we need some estimate on the time marginals of P*, uniformly in k. 

According to Lemma[2^ the law of {Xt} has a density pt such that p*" lies in L°°((0, T),1?{T))) 
and L2((0,T),e^(O)). Notice that the drift coefiicient b^(Xt) -^V(Xt) + ^[diV {Xt)\{Xl}]ex 
in Equation (|1.1|) is bounded, so that we can apply the Girsanov Theorem. Indeed, define 

Li = exp (-^ b1{X^:)dWs - i £ |16j(X^)f ds) . 
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Novikov's Condition is satisfied for tliis process, so tfiat tfie formuia 

for A £ a'{Ws)s<t, defines a probability distribution Qk on such that, under Qfe, the process 

is a Brownian motion. Denote jt the law of {X*} under Qfe. Notice that since, under Qk, is 
the sum of y/2 times a Brownian motion at time t and an independent random variable Xq , 7^ has 
a density with respect to the Lebesgue measure which is bounded by where Ti" is a constant 
not depending on k and t. As a result, for a given function ip in L'^(I?), one has 



< 



*(A-f) (j 



ip d7t 



1/2 



K 



where K m a. positive constant, which does not depend on k since \b'^\ is bounded from above 
by ||VF||l°°- Consequently, for any < t < T, HPsHl^cd) is bounded uniformly in k and in 
s G \t,T\. Moreover, since is a solution to Equation (|2.2I) in the sense of Definition [2Tl] it holds, 
from ([23J 

9t||Ps'llL2(x>) < -||VpJ||l2(j,) + K\\pt\\l■2^J,■^, 

so that (p'')fcgN is also bounded in 'L?{{t,T),lS}{Ti)). Adapting the proof of Lemma 13.81 we find 
that the family (pf^^) is compact in L'^((t, T), L'^(C')) for any open subset O of T). By a diagonal 
argument, and using the proof of Lemma [3.91 we can thus construct a subsequence fc„ such that 

• P''" converges to a probability measure whose time marginals Pt have a density p?, for 
all t > 0, 

• p*" converges almost everywhere on (0,T) x T) and in L^((0,r) x V) to p". 



converges almost everywhere on (0, T) x 2? to 



P 



0,diV 



Then, adapting the proof of Theorem 13.51 we see that P'' solves the martingale problem. 



□ 



3.4 Rate of convergence 

We are going to exhibit a control on the rate of the convergence of to p. Moreover, we give 



an estimate of the difference between 
quantity one is interested in practice. 



and the biasing force A'^ 



Pt 



Theorem 3.11. Under Assumptions\^ and\i^ it holds, in the compact case, 

lb'' ~ PllL°°((0,T),L2(T<i)) + lb'' - PllL2{{0,T),Hl{T'i)) < ^ {a + y/I), 



which is the 
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and, in the non compact case, under the additional AssumvtionUM 

lb'' " pIIl°=((o,t),l2(„)) + Hp'' - p||l2{{o,t),hi{«,)) < K{a + y^), 

for some positive constant K not depending on a and e. Moreover, we have the following hound on 
the estimation of the biasing force: 



n.diV a-iV 
fv*Pt' Pt 



•fin * Pt'^ Pt 



L2((0,T),L°°(T)) 



Proof. We give the proof in the non compact case, the one in the compact case being very similar. 
Similar calculations as in the proof of Theorem 1 2 . 6 1 vield : 

^dt\\pt + llVpt - Vp?||l2(„) < K\\pt -p?||L2{»)||Vpt - Vp?||l2(^) +K\\pt -PtWhi^^) 



We now estimate the last term. 



Pi 



Pi 



+ ||Vp?- Vpt||L2 



Pt ^ 



(w) 



Pt 



dlV „V,diV 



y Pt *fv 
Pt *Vv 



L2{™) 



+ 



Pt - 



1 1 



< IbtllL^ 



P\ ( 



Pt fin * Pt 



dlV v,dlV 

Pt -fin* Pt 



+ 



L2{u)) 



L°o{T) 



n ^0^ V 

iPt-pl)^^^^^ 

•fin *Pt 



+ \\Pth2 



L2{u,) 



n.diV 
Vn*Pt 



pH'Pv *Pt 



;p- {Vv *p1' -Pt) 



L=°(T) 



fin *Pt 



L2(m) 



From Lemma [1.21 pj is bounded from below uniformly in time. Using this together with the facts 
that diV is bounded and p G L°° ((0, T), L^(it))), one obtains 



Pt Pt * fin 



L2 (tt>) 



< K (jlpf"-^ - •fin *P?''''^||l~(t) + \\p] - fin *P?'^IIl~(t) + \\Pt 



Consequently, we have to estimate \\pl — fin * Pt ||l«= (t) and ||pf^^ — fin * Pt''^^^l|L«=(T)- It holds, 
for 7 G (0,1/2), 

l|pf'^ - V't? *P?'^'^I|l°=(T) < Wfin * (pf'^ -P?'®'^)I|l°o(t) + ||pf'^ - •fin *pf'^l|L~(T) 
<Ka^ llpf^'' -P?''^^||lo^(t) + llpf^^ - ^n *P^''||l~{t) 

S + llPt —Pt llei(T) IIP' ^Pt IIl2(t) ^ + IIP* —'P<i*Pt I|l°°(t) 
< (a+ Ibt -p;'||g(^+J||pt -p^lj^^^^j^j + Ibfi^ - (/?^ *pfi^||L=o(T). 

Likewise, we have 



WpI - V3„ *pJ''^|1l=o(t) < A'a + iCllpi -p^ll^f^+^llpt -p?||[{j.^j^ + WpI - i/?'; * Pt I1l«= (t)- 
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To conclude, notice that, in view of Lemma [0.1 1 pf^^ lies in H^(T). Thus pf^^ is Holder continuous 
with exponent 1/2 and constant C||pf^^ ||h1(t) (see [31 CoroUaire IX. 13]). Consequently, since ip^ = 
outside [— e, e], 



\ dlV / s dlV / \\ 



a / pt^^\x)Ax+ I tpe{y){pt^^ {x) ~ pt^^ {x - y))Ay 
Jt Jt 

<K[a + ||p^''||Hi(T)^^^.(y)dy) 



(3.10) 



< K [a + y/e\\pt\\wHw)) ■ 
The same inequality holds for p^ 

jpt(x) - ifir^ *pl{x)\ <K{a + \/e\\pt\W{:w)) ■ 
Gathering all the previous inequalities, we obtain, 

^ft||pt -P?||l2(„) + llVpt - Vp?||l2(„,) < -R'llpt -p?|lL2(„)|lVpt - Vp?|1l2(„) +-R'|lPt -P?||l2(ii,) 

+ -p?lle((:;i|Pt -P?lli^(T7l|Vpt - Vp?||,2(„) 
+ K{a + Ve||Pt||Hi{»)) II Vpt - Vp?||l2(„) 
+ Ka\\Vpt - Vp?||l2(„). 

Consequently, from Young's inequality, 

3t||pt -P?||l2(„) + II Vp? - Vpt||L2(„) < K (||pt -P?||l2(») + +e||pt|lHi{»)) • 

Gronwall's Lemma yields the first statement of Theorem l3.11l noticing that p lies in L^((0, T), (m)). 
For the second statement, arguing as we did above, it holds that 



'Pv *Pt Pt 



v.l 
ifr, * Pi 



Pt 



L°°(T) 



< K (^\pl -:fi,-i*p^'^\\^^ 



(T) 



+ \Wr,*Pt -Pt ' 



Il°°{t) 



< K [a + y/eWptWuHD + \\Pt - p1\Wh^)) 
We finish the proof by squaring this inequality and then integrating. 



□ 



4 An interacting particle system approximation 

In this section, we prove the convergence of the interacting particle system to the regularized non- 
linear processes, and we estimate the difference between the regularized biasing force '^'^ ^* i and 
its particle approximation. 

Theorem 4.1. Let T he a positive time. Under Assumptions\^\^\^and\^ the solution (X^ ^ j^) n>i 
of (|1.3|) with initial condition X^^^ — Xo,n converges to the solution X^^ to (|3.1|l with initial 
condition Xo,n in the following sense: for all 1 < n < N , and for e,a < 1, 

1 

—=e^, 



sup 

te[o,T] 
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K being some constant not depending on a, e and N . 
Moreover, one has 



sup 

te[0,T],a;leT 



I ) 



< -=e^. (4.1) 
~ v/7V 



Notice that the the right hand side of (|4.ip explodes when e goes to for a fixed value of A*', so 
that the size of e has to be chosen carefully depending on the value of A'^. We will also investigate 
this point numerically in the next section. 

To simplify notation, we omit the subscript and the superscript 77. We first establish the 
following inequality: 

Lemma 4.2. We have, for e,a < 1, and for any t in (0, T], 



K ( - 1 ^ - \ 



ds, 



where K does not depend on a, e and t, and is defined by 

iv 1 / 1 

\ ?7l= 1 

m — 1 

Proof. From the definition of Xt,n and Xt,n, we have 

\Xt,r^ - Xt,n\ < ^ (VV(X,,„) - VV{Xs,u)) ds 

Jo 



+ 



ds 



ds 



First, j Jjj* (Vl^(Xs.n) — VV(Xs,n)) dsj is bounded from above by K J* \Xs,n — Xs.n\ds, since is 
Lipschitz continuous. Now, we decompose 

E™=i vvixln - xl^)diV{Xs,^) 



y^(^i.n ^ xl^)diV{Xs,r^) E^i y^(^i,n - xi,„)aiy(x.,. 



E™=i - xl^)diV(Xs,m) *P?'^^^(Xi,n) 



(4.2) 



E^=l - ^1,™) ^^*pl''(Xl„) 

Using Assumptions |T] and |vj the first term in the right hand-side of (|4.2p can be bounded by 
(^|Xs,n — Xs,n\ + Em=i \XB,m — Xs,m\^ , aud the sccoud term in the right hand side of (|4.2[l 



can be bounded by KA" 



□ 
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Proof of Theorem \4-- 1\ As a consequence of Lemma 14.21 we get, for a,e < I 
K 



sup |Xt,„-Xt,„i < 
te[o,T] 



T / - 1 ^ - \ 

sup \Xs,n - Xs,n \ + "77 ^ SUp \Xs,m - Xs,m\ At + K 



a \sG[o,t] 



,1 se[o,t] 



Taking the expectation, and using the exchangeabihty of the couples (X„, X„)i<,i<jv, we get 



sup \Xt.n — Xt,„ 

te[o,T] 



K 



sup \Xs,„ — Xs 

se[o,t] 



dt + K E 



dt. 



By Gronwall's lemma, one obtains 



E 



sup \Xt,n - Xt. 

te[o,T] 



< Ke' 



dt. 



To conclude, we estimate 'E[A"'^]dt. Let 



$T = ^vixli - xU)d,v{Xt^^) - 



and 



We have, for t <T, using again the exchangeability of the couples {X„, X„)i<n<N , 



EA]; 



n,N 



< E 



<4 E 



K 



\ m = l / \ m = l / 



^ (e [$r$r'] + E [*r*r'] 



But the $r and *™ are centered for m > 2, and, for m / m', and 4)™ , (as well as vl>™ 
and ) are independent conditionally on Xt,i- Therefore the double products vanish, and, by 
exchangeability 



K 



(E +E[(*?)2]) + -ii-(E [($,^)^] +E[(v|/,i)^]) 



q27V2 V LV w J ' LV w j; ^2^2- 

But one has E [(^t^)^] +E [(*?)^] < Ke~'^ and E [{<i>lf] +E )^] < Ke''^, and the first assertion 
in Theorem |4T] follows. 

For the estimation of the force, adapting the proof of Lemma [4.21 we see that 



sup 

*6[0,T1 



^V^PI^, 1, Ell Vvi^' ~ Xl„^^)drV{Xt,n,N) 
r,.l \^ I 

N 



t6[o,T] iV;^, 



+ -E 

a 



sup 

te[o,T] 



1 



iV 



sup l-'^t," ^ -'^t, 

te[o,T] 
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Indeed, (<^^(x^ - Xln)diV{Xt^n) - <^,, * Pt'^^^ {x^))ne{i...N) , as well as {f^{x'^ ~ Xl^) ~ (p^ * 
Pt'^ix^))nG{i...N}, are i.i.d. centered random variables whose variance is bounded by uniformly 
in time. □ 



5 Numerical results 

In this section we give some numerical simulations to illustrate our previous results. Here, the 
parameter q, which was introduced to enable theoretical estimations, is taken to be 0. 

Notice that the simulation used here is not exactly the one actually used in applications. In 
particular, in those simulations time averages are used in order to smooth the problem : first the 
equation on At given in (|0.4|l can be replaced by 

dtA'tiz) = -{E[FiXt)\aXt) = z\~ At) 

T 

which makes At vary more smoothly. Second, one can use, in addition of the particle approximation, 
an ergodic average for the computation of the conditional expectation in (|l.ip . 

In order to accelerate the convergence, one can also use a selection mechanism that gives more 
weight to particles located in less explored areas (see |10)V 

5.1 Efficiency of the ABF method 

Let us introduce a low dimensional example to illustrate the efficiency of the ABF method and its 
particle approximation. 

In this first example, we simulated the particle approximation with 1000 particles, in the potential 
defined for [x, y) in [-2, 2] x R by 

Vi(x,?/) = 5e'"'"^' - 56-'"-^'"-''" - 5e-<"+'''-''' + 0.2a;^ + Q.2y\ (5.1) 

and extended periodically in the x direction with period 4. The level sets of Vi are depicted on 
Figure [T] 

On Figure [T] we also plotted the position of the particles after 2000 iteration of an Euler- 
Maruyama approximation of Equation (|1.3|) with a time step of 0.01. The value of the parameters 
are e = 0.01, /3 = 10 and — 1000. On Figure[2l we plotted the graph of the mean force (computed 
by numerical integration, which is still possible due to the low dimensionnality) , and the value of the 
approximate mean force computed on a regular grid. The L^— distance between the two functions 
is 6.93 X 10"^, while the L^-norm of the function A' is 12.9. 

Notice that without biasing force, one obtains a very poor sampling, since the particles do not 
escape from the well they started in: see Figure O where we plotted 200 independent simulations of 
a Langevin dynamics (|0.1|l using 2000 iterations of an Euler-Maruyama scheme of time step 0.01. 

On Figure 2] we show the distance between the actual value of the mean force A' and its 
approximation at time 20, obtained for one simulation of the system, as a function of the number of 
particles used in the simulation. Using a least square regression, we find that the slope of the curve 
is approximatively —0.59, which matches with the theoretical rate of N~^''^. 

5.2 Tuning of the parameters 

In Theorem 14. II we showed that the particle approximation converges as e goes to and N goes to 
infinity, provided that e does not go to zero too fast compared to A''. The practical difficulty that 
one encounters to apply this result is to choose a good scaling for e in term of N. 
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Figure 1: Contour plot of the potential Vi with the positions of 1000 particles at time t = 20. 




Figure 2: Particle approximation of the mean force. The smooth curve is the actual value of the mean 
force, the rough one is the approximation. 
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Figure 3: 200 independent realizations of a Langevin dynamics at time t — 20. 
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Figure 4: Error as a function of (logarithmic scale). 
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On Figure [5] we can see the error between the mean force and its aproximation at time 20, 
as a function of the parameter e, using A'^ — 1500 particles. 
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Figure 5: Error as a function of e. 

Actually, for a fixed value of A'^, there is only a small range of values for e for which the error is 
small. 

First, the limit of the error as e goes to does not even vanish as N tends to infinity. The reason 
is that, since the particles interact with each other in a range of e, the number of particles which 
interact with a given particle is of order eN. Hence, when e tends to while N is fixed, the particles 
cannot see each other. Therefore, the natural limit of the particle system in the limit e ^ 0, N 
fixed, should be a system of independent particles following the dynamics 

dXt = {-VV{Xt) + eidiV{Xt)) dt + y/2p^dWt. 

Unfortunately, in the general case, the drift in the above dynamics is not obtained as the gradient 
of a potential, so that no invariant measure for Xt is known. This would consequently induce a non 
vanishing bias in the estimation of A. 

For example, for the potential V{x,y) — ^{y — sin(27ra;))^, one can prove that the dynamics 
obtained by canceling the force on the reaction coordinate x, namely the couple {{Xt},Yt) defined 
by the dynamics 

dXt =V2dWt\ 

dYt = {-Yt + sm{2nXt)) dt + ^dW^ 

converges m law to the couple (C, /J" e"" sin(27r(^ + yf2Ws))ds + G) , where W is a standard Brow- 
nian motion, ^ is uniformly distributed on T, and G is a standard normal random variable, indepen- 
dent of W . This is not the correct limit distribution, since the law of Y conditionned to the value 
of {X} should be Gaussian, which is not the case here. 

For a large value of e, the behavior of the particle system can be really different from the expected 
behavior of the dynamic (|0.4|l . In the following example, the particles, instead of freely visiting the 
X axis, keep stuck in the local minima they started in. Indeed, the large value of e made that the 
biasing term is close to the mean of 9i on all particles, whose value is close to 0. Consequently, 

the biasing force is not large enough to prevent the particle from being trapped in the local minima. 
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Figure 6: Bad sampling due to a too large value of e. 



In the following example we considered the potential Vi defined in (|5.I[) . took e = I, and 
simulated 200 particles during 2000 iterations of time step O.OI. The result can be seen on FigurelHl 

One way to increase the sample size while keeping the number A'' of particles fixed is to include 
time averages for the estimation of the conditional expectation. This is actually the common practice 
in the applied community (see [Sill])- 

5.3 Discussion on the choice of the reaction coordinate 

We now give another example to illustrate the limitations of the ABF method. We consider the 
4-periodical potential (in the x-direction) defined for (a;, y) in [—2, 2] x R by 

V2{x,y) = 3e-"'-'^-'/^'' _ ^g-^^-iv-^/af _ ^^-(:,-if-y' - 5e-<"+'''-^' + 0.2a;* + 0.2(i/ - 1/3)*, 

(5.2) 

whose level sets are depicted on Figure [T] This potential has been introduced in [14^. 

The potential V2 displays two deep minima approximately located at (±1,0). There is a maxi- 
mum located at (0,0.5), so that there are two possible paths between the main minima. The first 
one is a direct path meeting a saddle point approximately at (0, —0.3). The other path goes through 
two saddle points at (±0.5, 1) and a small minima at (0, 1.5). Even if the first path is more direct 
than the second one, the prefered path in low temperature regimes will be the second one, since its 
energy barrier is smaller. 

We simulated the particle approximation of the ABF method with A'^ — 1000 particles, window 
width £ = 0.01, after 2000 iterations of an Euler-Maruyama scheme of time step 0.01, and plotted 
the positions of the particles on Figure [T] 

At the low temperature P = 10, the particles are expected to hop from one well to the other 
mainly through the upper channel, which is not the case here. This is due to a bad choice of the 
reaction coordinate. Indeed, the biasing force only acts in the x direction, so that a particle trapped 
in the left side well will naturally escape through a horizontal path, and will take the lower channel. 
As a result, the computation of the force is clearly biased, because of the poor sampling of the upper 
channel, see Figure [S] the L^— distance between the two functions is of 0.4. 

We still have convergence to the correct mean force, but at a slow rate, since the reaction 
coordinate has not been chosen in an optimal way. Indeed, with the same parameters, but after 
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Figure 7: Poor sampling due to a bad choice of the reaction coordinate. 




Figure 8: Biased evaluation of the biasing force due to a bad choice of the reaction coordinate. The 
smooth curve is the value of the mean force. The rough curve is the approximation. Here, the approxi- 
mation does not see the variations of the mean force around 0. 
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2.10^ iterations, the result is much better, see Figures [9l and [TOl The L^— distance between the mean 
force and its approximation is of 0.15, while the function A' has L^— norm 10.9. 
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Figure 9: Same simulation as on Figure [7] at time 2000. 
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Figure 10: Approximation of the free energy corresponding to Figure [51 The smooth curve is the free 
energy, the rough one is the approximation. 
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